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TRENDING SYSTEM AND METHOD USING MONOTONIC REGRESSION 

FIELD OF THE INVENTION 

[0001] This invention generally relates to diagnostic systems, and more 
specifically relates to trending systems for mechanical systems. 

BACKGROUND OF THE INVENTION 

[0002] Modem mechanical systems can be exceedingly complex. The 
complexities of modem mechanical systems have led to increasing needs for 
automated prognosis and fault detection systems. These prognosis and fault detection 
systems are designed to monitor the mechanical system in an effort to predict the 
future performance of the system and detect potential faults. These systems are 
designed to detect these potential faults such that the potential faults can be addressed 
before the potential faults lead to failure in the mechanical system. 

[0003] One type of mechanical system where prognosis and fault detection is of 
particular importance is aircraft systems. In aircraft systems, prognosis and fault 
detection can detect potential faults such that they can be addressed before they result 
in serious system failure and possible in-flight shutdowns, take-off aborts, delays or 
cancellations. 

[0004] Current prognosis and fault detection systems have relied upon data 
trending of data from the mechanical system to predict future performance and detect 
likely faults. In general data trending involves filtering the data to generate a more 
accurate, filtered estimate of the data. Additionally, data trending can include 
generating predicted likely future values for the sensor data. Each of these data 
trending fimctions facilities prognosis and fault detection in the mechanical systems. 
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[0005] Current systems have used various statistical techniques for fiUering data. 
As examples, past trending systems have used such as Kalman filters or exponential 
filters to filter data. Unfortunately, these current trending systems suffered fi-om 
many limitations. One particular limitation in current trending systems is a lack of 
accuracy. Thus, these trending systems are unable to accurately determine cxirrent 
sensor values or predict likely fiiture values. This lack of accuracy limits the 
effectiveness of the prognosis and fault detection system, resulting in potentially 
unexpected faults and/or false detection of fiiture faults. 

[0006] Thus, what is needed is an improved system and method for trending data 
in mechanical systems that offers improved accuracy and reliability. 

BRIEF SUMMARY OF THE INVENTION 

[0007] The present invention provides a system and method for trending 
performance in a mechanical system. The trending system includes a performance 
estimator and a predictive trending mechanism. The performance estimator receives 
sensor data from the mechanical system and generates performance parameter 
estimates for the mechanical system. The performance parameter estimates are 
parametric data that are indicative of performance in the mechanical system. The 
performance parameter estimates are passed to a predictive trending mechanism. The 
predictive trending mechanism determines an estimated trend for the performance 
parameter estimates through monotonic regression of the performance parameter 
estimates. The estimated trend of the performance parameter estimates can include 
filtered values of the performance parameter estimates and/or predictions of fiiture 
performance parameters. 

[0008] The foregoing and other objects, features and advantages of the invention 
will be apparent from the following more particular description of a preferred 
embodiment of the invention, as illustrated in the accompanying drawings. 
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BRIEF DESCRIPTION OF DRAWINGS 

[0009] The preferred exemplary embodiment of the present invention will 
hereinafter be described in conjxmction with the appended drawings, where like 
designations denote like elements, and: 

[0010] FIG, 1 is a schematic view of a trending system system; 

[0011] FIG. 2 is a flow diagram illustrating a trending method method; 

[0012] FIG. 3 is a schematic view of a exemplary embodiment performance 
estimator; 

[0013] FIG. 4 is a schematic view of an exemplary embodiment predictive 
trending mechanism; 

[0014] FIG. 5 is a graph of exemplary noisy data set and an underlying trend; 

[0015] FIG. 6 is a graph of several exemplary estimated trends obtained using 
monotonic regression; 

[0016] FIG. 7 is a graph of another estimated trend obtained using monotonic 
regression; 

[0017] FIG. 8 is a graph of exemplary noisy data set, an underlying trend, and an 
estimated trend obtained using second-order monotonic regression; 

[0018] FIG. 9 is a graph of several estimated trends obtained using second-order 
monotonic regression; 

[0019] FIG. 10 is a graph of several estimated trends obtained using second-order 
monotonic regression; 
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[0020] FIG. 1 1 is a graph of several estimated trends obtained using second-order 
monotonia regression; 

[0021] FIG. 12 is a exemplary noisy data set, an imderlying trend, and an 
estimated trend obtained using second-order monotonia regression, and an estimated 
trend obtained using a Kalman filter; and 

[0022] FIG. 13 is schematic view of an exemplary computer system implementing 
a trending system. 

DETAILED DESCRIPTION OF THE INVENTION 

[0023] The present invention provides a system and method for trending 
performance in a mechanical system. The trending system receives sensor data and 
generates performance parameter estimates. The trending system then determines an 
estimated trend for the performance parameter estimates through monotonic 
regression of the performance parameter estimates. 

[0024] Turning now to FIG. 1, a schematic view of a trending system 100 is 
illustrated. The trending system 100 includes a performance estimator and a 
predictive trending mechanism. The performance estimator receives sensor data from 
the mechanical system and generates performance parameter estimates for the 
mechanical system. The performance parameter estimates are parametric data that are 
indicative of performance in the mechanical system. The performance parameter 
estimates are passed to a predictive trending mechanism. The predictive trending 
mechanism determines an estimated trend for the performance parameter estimates 
through monotonic regression of the performance parameter estimates. The estimated 
trend of the performance parameter estimates can include filtered values of the 
performance parameter estimates and/or predictions of fiiture performance 
parameters. 
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[0025] The trending system uses monotonic regression to generate the estimated 
trend of the performance parameter estimates. Monotonic regression, as the term is 
used in this application, is a statistical technique for trending data that assumes that 
the underlying trend is monotonic and produces a monotonic estimated trend output. 
The estimated trend output is optimal in the sense of a chosen statistical criterion. As 
fiirther described in this application, a monotonic regression can provide an optimal 
nonlinear trending for determining trends of performance parameters based on noisy 
sensor data. Monotonic regression relies upon the assumption that the performance 
will only deteriorate with time. This assumption is reasonable for performance 
parameters configured to be associated with accumulating wear and damage to 
mechanical systems. By relying upon this assumption, monotonic regression 
facilitates reliable detection of fault conditions and accurate estimation of even weak 
trends in very noisy data. 

[0026] In one implementation of monotonic regression, the trend is determined as 
a maximum likelihood estimate of the orbit in a hidden Markov model. This model 
assTjmes a one-sided exponentially distributed noise in the performance parameter. 
This noise model leads to a nonlinear filter where the trend can be estimated by 
solving a quadratic programming (QP) problem. While this method is more 
computationally complex than traditional Kalman filters, which assiime Gaussian 
distributed noise, it offers trending that is vastly superior in performance. 

[0027] Turning now to FIG. 2, a mettiod 200 is illustrated for trending 
performance in a mechanical system. First step 202 is to receive sensor data firom the 
mechanical system. This can include receiving sensor data directly from sensors on 
the mechanical system and it can include receiving data from secondary sources. 
Furthermore, the sensor data can comprise actual raw sensor data, other sensor data 
values derived from raw sensor data by data processing, or a combination of both. 
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[0028] The next step 204 is to generate performance parameter estimates from the 
sensor data. The performance parameter estimates are parametric data that are 
indicative of performance in the mechanical system. The performance parameter 
estimates and indicative of performance in the mechanical system, and as such are 
representative of accumulating wear and/or damage in the mechanical system. As 
will be described in greater detail later, the performance parameter estimates are 
designed and implemented to monotonic, such that they can be assured to degrade 
with time as wear accumulates in the mechanical system. 

[0029] As one example, the performance parameter estimates can be generated 
from residuals that are derived from sensor data. In this implementation, residuals are 
generated by comparing the received sensor data to expected sensor values and 
determining the difference. Generally, the expected sensor values are provided by a 
model of the mechanical system. The model receives sensor data and generates 
expected values for sensor data. It should be noted that the expected values generated 
by the model can comprises the same set of originally received sensor values, a subset 
of the originally received sensor values, and/or can comprises different sensor values 
altogether. 

[0030] The next step 208 is to determine an estimated trend of the performance 
parameter using monotonic regression. This estimated trend of the performance 
parameter estimates can include filtered values of the performance parameter 
estimates and/or predictions of future performance parameters. In filtering values of 
the performance parameter estimates the estimated trend can provide more acciirate 
performance parameters, reducing or eliminating the effects of noise in the system. In 
predicting fixture performance parameters the estimated trend can determine a 
predictive envelope of fixture values used to predict fixture performance in the 
mechanical system. 
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[0031] Monotonic regression relies upon the assumption that the performance 
represented by the performance parameter will only deteriorate with time. This 
assumption is reasonable for performance parameters that are designed to be 
associated with accumulating wear and damage to mechanical systems. Monotonic 
regression can provide an optimal nonlinear trending for determining trends of 
performance parameters even when provided noisy sensor data. 

[0032] In one implementation of monotonic regression, the trend is detemiined as 
a solution to a quadratic programming problem. The solution to the quadratic 
progranmiing problem provides filtered performance parameter values that more 
accurately represent the performance of the mechanical system. 

[0033] As one specific example, the method 200 can be used for trending 
performance in turbine machinery such as a turbine engine system. In a turbine 
engine implementation, step 202 is performed by receiving sensor data firom the 
turbine engine and other aircraft systems. For example, the received sensor data be 
taken directly fi-om the engine such as fiiel flow, exhaust gas temperature and engine 
speed. As other examples the sensor data can include data taken fi-om other systems 
on the aircraft, such as airspeed, altitude and ambient temperature. 

[0034] In step 204 for a turbine engine, the performance parameter estimates can 
be generated based on residuals generated fi-om the received sensor data. For 
example, expected sensor values are generated by a performance model of the turbine 
engine. The turbine engine performance model receives sensor data such as airspeed 
data, altitude data, and ambient temperature data. From that data, the turbine engine 
performance model can generate expected values for exhaust gas temperature and 
engine acceleration. These generated expected values can then be compared to 
corresponding received sensor values to generate the residual. The resulting residuals 
are then used to create the performance parameter estimates. 
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[0035] In the turbine engine example, the performance parameter estimates can 
comprises a variable such as one that tracks turbine efficiency. Turbine efficiency is a 
fimction of wear and damage in the turbine engine. A performance parameter can be 
designed and implemented to indicate the turbine efficiency. This turbine efficiency 
performance parameter can be estimated based on the residuals for measured sensor 
data such as fuel flow and EGT. During analysis, the residuals for the measured 
sensor data are used to generate estimates of the turbine engine performance 
parameter. Because the turbine efficiency performance parameter tracks performance 
that is associated with wear in the turbine engine, it can be reasonable assumed to be 
monotonic — ^meaning that the associated performance will pnly degrade with time 
absent some intervening maintenance or repair. 

[0036] Finally in step 206 for a turbine engine, monotonic regression can be used 
to trend turbine efficiency parameters. This trending can include filtering the 
performance parameter estimates of turbine efficiency to determine the actual 
performance parameters fi-om relatively noisy estimates. Furthermore, this can 
include, the predictions of future turbine engine efficiency perfomiance parameters 
based on the current trends in the performance parameter. This information can then 
be used to detemiine when a turbine engine needs to be pulled for repair or other 
maintenance action taken. 

[0037] Turning now to FIG. 3, a performance estimator 300 for mechanical 
systems is illustrated. Performance estimator 300 is exemplary of the type of 
performance estimators that can be used in the trending system of the present 
invention. The performance estimator 300 includes a predictive model, a residual 
generator, a parameter estimator and a signature model. 

[0038] In general, the performance estimator 300 receives sensor data fi*om the 
mechanical system and generates performance parameter estimates from that sensor 
data. The performance parameter estimates can be any type parametric data that are 
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derived from the sensor data and are indicative of some type of performance in the 
mechanical system. 

[0039] The sensor data received by the performance estimator 300 can include 
sensor data directly from sensors on the mechanical system and it can include sensor 
data from secondary sources, or a combination of both. It should also be noted that 
the sensor data received by the performance estimator 300 could include actual raw 
sensor data, other data values derived from sensor data processing, or a combination 
of both. The sensor data is passed to the predictive model and to the residual 
generator. 

[0040] The predictive model receives sensor data and generates expected output 
values from that sensor data. Again, this sensor data can include actual raw sensor 
data, other data values derived from the raw sensor data, or a combination of both. 
The predictive model can use a wide variety of different systems and methods for 
generating the expected output values from the sensor data. For example, a predictive 
model can be developed using a physics model of the system that is validated against 
experimental data. As another example, the predictive model can be developed with 
data-driven techniques such as neural networks. In this implementation, a neural 
network is configured and trained to output expected output values based on received 
sensor data. It should be noted that the expected output values generated by the 
model can comprise the expected values for the originally received sensor data values, 
a subset of the original sensor data values, or for different sensor values altogether, 
such as data derived from the originally received sensor data values as a result of 
mathematical signal processing. 

[0041] The expected output values are passed to the residual generator. The 
residual generator compares the expected output values to the actually observed 
values to determine residual differences. The residual difference could be a simple 
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linear difference, or a more complex calculation of the differences between the 
actually observed values and the expected output values. 

[0042] The prediction residuals are passed to a parameter estimator. The 
parameter estimator estimates of the degradation of the performance parameters based 
on the residuals and a performance deterioration signature model. The signature 
model is a description of the relationship between the prediction residual value 
changes and changes (deterioration) in the performance parameters. For example, a 
signature model can be developed to describe how certain changes in selected 
perfomiance parameters corresponding to specific types of mechanical system 
deterioration affect the prediction residuals. The signature model can thus serves as 
the basis for generating perfomiance parameter estimates from the received residual 
values. As one example a linearized model of the relationship between the 
performance parameter changes might be used and and estimate of the performance 
parameter changes (degradations) can be obtained by a generalized least square 
method. Of course other more general nonlinear models and other methods for 
estimating the performance parameter changes from the residuals can be employed 
within the framework of this system. 

[0043] The parameter estimator thus generates performance parameter estimates 
based on the signature model and the received residuals. The derived performance 
parameter estimates are indicative of performance in the mechanical system, and as 
such are representative of accxmiulating wear and/or damage in the mechanical 
system. The performance parameter estimates are designed to monotonic, such that 
they can be assured to track performance that degrades with time as the mechanical 
system wears. 

[0044] Turning now to FIG. 4, a predictive trending mechanism 400 for trending 
mechanical systems is illustrated. Predictive trending mechanism 400 is exemplary of 
the type of monotonic regression trending mechanism that can be used in the trending 
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system of the present invention. The predictive trending mechanism 400 includes a 
QP problem formulator, a QP problem solver, an output processor and monotonic 
regression tuning parameters. In general, the predictive trending mechanism 400 
receives performance parameter estimates from the performance estimator and 
generates an estimated trend of the performance parameter estimates. 

[0045] The predictive trending mechanism 400 determines the estimated trend of 
the performance parameter using a monotonic regression computational technique. In 
the illustrated embodiment, the monotonic regression computation is performed by 
solving a properly stated quadratic programming (QP) problem. To enable this, the 
performance parameter estimates are passed to the QP problem formulator. The QP 
problem formulator takes the performance parameter estimates and organizes the 
performance parameter estimates into a format that the QP problem solver can work 
with. Typically, this would involve taking a batch of performance parameter 
estimates and formatting that batch into a suitable data set, such as a set of matrices or 
sparse arrays required by the QP solver. The size of the batch would depend upon the 
application and the available number of performance parameter estimates. As one 
example, several thousand performance parameter estimates can be formatted and 
inputted to the QP problem solver when an estimated trend is to be determined. 

[0046] Additionally, the QP problem formulator receives monotonic regression 
tuning parameters. The monotonic regression tuning parameters are used to 
determine the computational and estimation tradeoffs used in solving the quadratic 
programming problem. A more detailed example of monotonic regression tuning 
parameters and how such values can be determined is discussed below in greater 
detail. 

[0047] The QP problem solver receives the formatted performance parameter 
estimates and the tuning parameters and generates a set of filtered performance 
parameters. The filtered performance parameters more accurately represent the true 
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performance of the mechanical system the originally received performance parameter 
estimates. Specifically, the filtered performance parameters more accurately 
represent the underlying performance by reducing the effects of noise in the original 
system data. Typically, an entire batch of filtered performance parameter estimates is 
generated as the solution to one quadratic programming problem. Thus, the QP 
problem solver offers a batch mode solution to generating filtered performance 
parameter estimates. 

[0048] The QP problem solver can be implemented with a variety of quadratic 
programming tools. For example, QP solving tools are available as part of the 
MatLab Optimization Toolbox, including a function QUADPROG.M that can be used 
to solve these types of quadratic programming problems. Of course, other freely 
available or commercial QP solving packages could also be used, including NAG 
software libraries. Most commercially available QP solvers function by imposing a 
linear constraint of a monotonic data change in the quadratic programming problem. 
Many different modem QP solver packages are available with the desirable feature of 
being based on Interior Point methods. The QP solvers based on Interior Point 
methods can provide a fast and reliable solution of very large QP problems with 
several thousand variables. 

[0049] The filtered performance parameters estimated by the QP solver are passed 
to the output processor. The output processor takes the filtered performance 
parameters and formats the output. Additionally, the output processor can generate 
predictions of future performance parameters. The predictions of future performance 
parameters are used to prognosticate the future performance of the system, and can 
thus be used to determine when future maintenance will be required for the 
mechanical system. The predicted future performance parameters can be calculated 
using many different suitable techniques. For example, when using a second-order 
monotonic regression analysis, the predictions of future performance parameters can 
be obtained by extending the linear trend estimated at the last available data point. An 
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example of such a second-order monotonic regression analysis will be discussed in 
greater detail below. Other suitable techniques could be used to predict future 
performance parameters. For example, a least squares analysis (e.g., least square 
curve fit) of the filtered performance parameters can be used to determine predicted 
future performance parameters. 

[0050] The predicted future performance parameters can be obtained in a variety 
of forms, including as sets of discrete predicted future values or in the form of a linear 
function describing the current trend. In any case, the predictions of future 
performance parameters can then be used to prognosticate as to the future evolution of 
performance of the mechanical system. 

[0051] A detailed example of a specific monotonic regression technique will now 
be discussed. In this example, the received performance parameter estimates are an 
observed data sequence Yn^ Monotonic regression is used determine the orbit or 
underlying trend x(t) from the received performance parameter estimates Ijv, where 
the underlying trend x(t) is made up of a data sequence of filtered performance 
parameters X//. Stated another way, the or underlying trend x(t) of a filtered 
performance parameters X/^ is based on an observed data sequence of performance 
parameter estimates Yjv, where X/^ and Ym are defined as: 



[0052] And where the underlying performance parameter data is assiimed to be 
monotonic such that: 



X^={x(l),...,x(«)} 



(1.) 



7^= Ml),.. .,;;(«)} 



(2.) 



{x(l)<x(2)<...<x(«)} 



(3.) 
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[0053] The underlying trend or maximum orbit x(t)cein be foimd with the 
following optimization problem by solving for the x(t) sequence that optimizes the 
loss index J: 

j = -L[xil)-xJ +^t,[x{t)-yit)Y +A.f^[xit)-xit-l)] ^min (4.) 
2Qq 21 /=i 

[0054] where Qo is the initial condition covariance, T is the assumed covariance 
of the gaussian observation noise, and X is the assumed covariance of the exponential 
one-sided noise driving the underlying trend evolution. The noise covariances in 
equation 4 play a role analogous to the noise covariances in a usual Kalman Filter. 
These covariances could be estimated from the data, but ultimately are used as the 
tuning parameters of the filter. With equation 3 taken as a hard constraint, the last 
sum cancels out except for x(l) and x(n). In the case where no apriori information 
about xo is available, it can be assumed that the initial condition covariance Qo oo, 
and the first term of equation 4 can be dropped. Solving equation 4 will then yield a 
Maximal Likelihood estimate of the orbit x(t). The Maximal Likelihood estimation 
problem in this case can be re- written in the more compact form as: 

J = -\\X^ -Y^f ->min (5.) 

DXf, > 0 (6.) 



F^=[l 0 0 ••• -l] (7.) 
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[0055] where ^=7JT. To determine the underlying trend, equation 5 is solved for 
a data sequence Xn of filtered performance parameters that optimizes the loss index J, 
This is a quadratic programming problem that can be solved with computational 
methods such as interior point methods. For example, it can be solved with 
QUADPROG.M function or other QP related codes provided as part of the Matlab 
Optimization toolbox. 

[0056] As one example, such a problem can be solved assuming the initial 
condition covariance Qo is infmite, and the second term in equation 5 disappears. In 
this case, the Maximum Aposteriori Probability (MAP) becomes a Maximum 
Lilcelihood (ML) estimate and depends upon a single tuning parameter p. 

[0057] The tuning parameter p is preferably selected empirically to achieve the 
desired performance of the system, to achieve the desirable tradeoff in filter noise 
rejection and trend following performance. In general for a large P the system will 
draw a monotonic regression that would jump in the end to accommodate for the last 
data point that is above the trend. As P goes to infinity, the regularization penalty 
given by the last term in equation 4 vanishes. In that case the trending becomes very 
sensitive to outHers, especially those coming as the first or last point of the data batch. 
For a small P, the system assumes that the observed in data might be a random outlier 
and follows an average monotonic regression trend observed through previous data 
points. As p goes to zero the regularization penalty given by the last term in equation 
4 dominates the optimization problem. Thus, the tuning parameter P is essentially a 
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smoothing parameter, analogous to a time constant of first-order exponential filter, 
and is best determined in many cases through trail and error. 

[0058] Tuming now to FIG. 5, a graph 500 illustrates an exemplary data set used 
for testing the trending system. The graph 500 includes a dashed line showing the 
underlying trend (i.e., the orbit), which includes as a slope 0.02 ramp with a 30 
sample duration and then, after a 15 sample interval, a 0.5 step. Also illustrated in 
graph 500 is a data set derived firom the underlying trend by adding uncorrelated 
random noise uniformly distributed on the [-1,1] interval. The resulting noisy data set 
was then used to test the trending system to determine the ability of the trending 
system to determine the underlying trend firom noisy data. 

[0059] Tuming now to FIG. 6, a graph 600 illustrates several estimated trends 
obtained fi-om the noisy data of FIG. 5 using equations 5-8 as part of an exemplary 
trending system. Each of these estimated trends is made up of a data sequence Xn of 
performance parameters that have been "filtered" to reduce the effects of noise in the 
original data. Specifically, graph 600 shows several estimated trends obtained using 
different values of the tuning parameter, p={ 10, 2, 1/2, 1/4, 1/8}, As can be seen, 
each of the estimated trends closely follows the overall pattem of the original 
underlying trend data, with the main differences arising in the handling of boxmdary 
conditions. For larger values of P (i.e., 10, 2, 1/2) the trends only different in the first 
and last seven points. The middle part of the estimate is the same. For the smaller 
values of P (i.e., 1/4, 1/8) the edge effects propagate further inside but still the middle 
part of the estimate is essentially the same. 

[0060] Tuming now to FIG. 7, a graph 700 shows the results of a monotonic 
regression using a timing parameter value of P=l/2 compared to results obtained using 
a conventional exponential filter solution. Also illustrated in graph 700 is the raw 
observed data and the underlying trend. As is illustrated in graph 700, the estimated 
trend determined by monotonic regression has less delay and is overall much closer to 
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the underlying trend then the result generated with exponential filtering. Thus, this 
example shows that monotonic regression can provide improved trending 
performance over traditional exponential filtering methods. 

[0061] While the monotonic regression technique described in equations 1-10 is 
adequate for many implementations, it may not be sufficient to adequately describe 
systematic deterioration trends in certain data sequences. Such trends show an 
increased deterioration for each new data point which would appear as an upward 
slope on the trend, while the described first-order monotonic regression only registers 
upward jumps in the data and yields trends consisting of many flat segments. In fault 
diagnostics and prognostics, systematic trends are important indications of impending 
failure and as such can be used for evaluating the need for preventive maintenance. A 
second-order monotonic regression analysis can be performed to more accurately 
determine systematic trends fi*om performance parameter estimates. The second- 
order monotonic regression analysis can be conveniently used in predicting fiiture 
values of the performance data, sometimes referred to as prognostication or predictive 
trending. Specifically, since the second order monotonic regression estimates both a 
slope and intercept of the trend at each data point, it can be conveniently used for 
prognostics, by assuming that the slope and intercept estimated at the last point 
describe a straight line indicative of the fiiture deterioration. 

[0062] A detailed example of a specific second-order monotonic regression 
technique will now be discussed. In this example, the received performance 
parameter estimates are an observed data sequence Y^. Monotonic regression is used 
determine the orbit or underlying trend x(t) from the received performance parameter 
estimates F//, where the underlying trend x(t) is again made up of a data sequence of 
filtered performance parameters JGv. In the second -monotonic regression case, the 
underlying trend includes two components such that x(t) = [xj(t) X2(t)], 
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[0063] In this model, xi(t) describes the systematic deterioration rate that defines 
the prognostics of the trend and will only increase with time. The deterioration rate 
xj(t) could include a systematic average performance loss for the cycle. The model 
can be conveniently used for describing the accumulation of secondary damage in the 
system caused by a primary fault condition. In that case, X](t) corresponds to the 
intensity of the primary fault condition and X2(t) describes the secondary damage 
accumulating because of this primary fault condition. The secondary damage keeps 
accumulating as long as the primary damage exist and the rate of its accumulation can 
only grow because the primary damage could only grow. 

[0064] One example of a primary/secondary damage mechanism for a turbine 
engine is a primary damage in the combustor leading to hot streak in the turbine gas 
flow. This hot steak would stress the turbine and cause an accumulation of the turbine 
blade damage (erosion, bum through, soot, material fatigue). The severity of the 
primary combustor fault would increase with time leading to a faster accumulation of 
the secondary damage of the turbine blades. 

[0065] As another example of an application for second-order monotonic 
regression, in turbomachinary the secondary damage model could be combustor liner 
or nozzle damage leading to a distorted temperature pattem. This fault condition 
would persist and grow worse in time. The observed effect of such would be indirect, 
through a performance loss of high-pressure section. A hot streak caused by the 
combustor fault would lead to deterioration (bum through) of turbine blades and 
vanes at each flight cycle. The result is a consistently growing performance loss. 

[0066] In second-order monotonic regression, the underlying trend x(t) is again 
assumed to monotonic. Specifically, in this case the underlying trend x(t) = [xi(t) 
X2(t)] is assumed to be monotonic such that: 



{x,{\)<x,(2)<,,,<x,(jt)} 



{x^(\)<x^{2)<,..<x^{n)} 



(9.) 
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[0067] The maximum a posteriori probability estimate of the underlying trend 
xf^can be found with the following optimization problem by solving for the x(t) = 
[xi(t) X2(t)] sequences that optimize the loss index J: 



J = comt + \[x{\)--xjQ~'[x{\)-x,]^^j^^ 
^ -^l t=\ 

1 1 1 ^ ^^"-^ 

— [x, (N) - X, (1)] + — [x, (N) - X, (2)] + J- J] X, (0 ^ min 

^ ^2 ^ /=! 



[0068] Where const is constant term not influencing the solution, Qo is the initial 
condition covariance, T is the covariance of the gaussian observation noise and Xi and 
X.2 are the covariances of the exponential one-sided noises driving the evolutions of 
the primary damage and the secondary damage variables xj(t) and X2(t) respectively. 
In the case where no apriori information about xo is available, it can be assumed that 
the initial condition covariance Qo oo, and the second term of equation 10 can be 
dropped. Solving equation 10 will then yield a Maximal Likelihood estimate of the 
underlying trend x(t). The Maximal Likelihood estimation problem in this case can be 
re-written in the more compact form as: 

^ = ~ \\^2.N - Yn ir + ^/^i,^ + ^2^^2,;v ^ min (11.) 
^i.^=k(l)--^iWf (12-) 



^2,;.=k(l)-^2(^)f (13.) 
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[0069] Unlike the first-order monotonic regression problem, this second order 
monotonic regression problem is ill-defined (underspecified). That is, the Hessian of 
the quadratic form of equation 1 1 has only J\r nonzero singular values out of IN total. 

[0070] In this case, the Maximum Aposteriori Probability (MAP) becomes a 
maximum likelihood estimate and depends upon two tuning parameters Pi and P2- 
The parameter p2 provides a penalty of the fault estimate x through observation time 
and is essentially similar to the parameter p in the first-order monotonic regression 
problem. The parameter pi provides a penalty for the linear trend in the data and 
characterizes the amplitude of the driving noise xj. Thus, as Pi goes to zero the 
second-order monotonic regression estimate coincides with the first-order monotonic 
regression. Conversely, as pi goes to infinity only the average linear trend is 
estimated. Choosing parameters Pi and P2 would preferably be done to achieve a 
desirable tradeoff in the filter noise rejection and trend following performances. This 
is thus analogous with choosing the driving noise covariances in a second-order 
Kalman Filter, which is well understood for someone skilled in the art, and could 
follow the similar intuition. 

[0071] Turning now to FIG. 8, a graph 800 illustrates an exemplary data set used 
for testing the second-order monotonic regression trending system. The graph 800 
includes a dashed line showing the underljdng trend, which held a constant value for 
15 samples, then stepped up by 0.4 then was constant for 35 more samples, then 
started ramping up with the slope of 0.04 per sample. Also illustrated in graph 800 is 
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a data set derived from the underiying trend (i.e., the orbit) by adding uncorrelated 
random noise xmiformly distributed on the [-1,1] interval. The resulting noisy data set 
was then used to test the trending system to determine the ability of the trending 
system to estimate the underlying trend from noisy data. 

[0072] Also illustrated in graph 800 are the trends obtained from the noisy data 
set by applying the second-order monotonia regression using equations 11-17. In this 
illustrated example, the tuning parameters were set at pi =1 and P2 = 1/2. Once again, 
the trend estimated by the system compares closely to the underlying trend despite the 
presence of noise in the data that has about the same or larger amplitude than the 
estimated signal. 

[0073] Turning now to FIG. 9, a graph 900 illustrates several estimated trends 
obtained from the noisy data of FIG. 8 using equations 1 1-17 as part of an exemplary 
trending system using second-order monotonic regression. Specifically, graph 900 
shows several estimated trends obtained using a value of tuning parameter Pi = 1 and 
several different values of the tuning parameters P2={5, 2, 1/2, 1/5}. When pi is 
between 1 and 10 the trends look essentially the same. 

[0074] Turning now to FIG. 10, a similar graph 1000 illustrates several estimated 
trends obtained from the noisy data of FIG. 8 using equations 11-17 and using a 
value of tuning parameter Pi = 1/10 and several different values of the tuning 
parameters p2={5, 2, 1/2, 1/5}. These trends are only slightly different then those 
illustrated in graph 900. For a small P2 (e.g., for p2 =1/5) the solver fits a concave 
piece-wise linear trend into the data. For a large P2 (e.g., for p2 = 5) the second order ' 
monotonic regression yields a piece wise constant trend, which is similar to a first 
order monotonic regression solution of the previous section. This is because the large 
p2 corresponds to a large covariance X2 in the noise model. In turn, large state 
equation noise means slower filtering, and a slow filter for the coordinate X2 means a 
piece wise constant solution that is not very response to changes in the data. Similarly, 
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a small P2 corresponds to a small covariance %2 and this leads to the part of the filter 
that follows the model for the coordinate jc/ providing the dominant (slow) dynamics 
jdelding a piece-wise linear concave fimction. 

[0075] Turning now to FIG. 1 1 , a similar graph 1 100 illustrates several estimated 
trends obtained from the noisy data of FIG. 8 using equations 11-17 and using a 
value of tuning parameter P2 = 1 and several different values of the tuning parameters 
pi={10, 3, 1, 1/3, 1/10}. As discussed above, the obtained estimated trends are 
basically the same for the all values of Pi, with the only exception being Pi == 1/10 that 
exhibits more discontinuities and jumps. 

[0076] Tuming now to FIG. 12, a graph 1200 illustrates a comparison of 
estimated trends obtained using second-order monotonic regression compared to 
trends obtained using a traditional stationary Kalman filter. Specifically, graph 1200 
illustrates the estimated trends obtained from the noisy data of FIG. 8 using equations 
11-17 £ind using a value of timing parameter Pi = 1 and tuning parameter P2 = 1/2 in a 
second order monotonic regression analysis. In addition, graph 1200 shows the raw 
data and the underlying trend. As one can see, the second order monotonic regression 
estimate recovers the underlying trend with far improved quality of estimation 
compared to the Kalman filter. 

[0077] For some practical trending applications, the two above described methods 
(first-order monotonic regression trending and the second-order monotonic regression 
trending) can be combined together. As one example implementation, the second- 
order trending is applied to the end of the data sequence (e.g., the last 80 to 100 data 
points) and can serve to predict the trend into the fixture. The prediction can be 
obtained by extending the estimated solution of the second order analysis into the 
fixture by assuming that the fixture noises are zero. In this case it may be also be 
desirable to process the first part of the data sequence using the first order trending 
techniques that are typically scalable to a much larger sequence size. Thus, the two 
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methods can be merged together though the boundary conditions to ensure 
monotonicity of the integrated trend. 

[0078] The trending system and method can be implemented in wide variety of 
platforms. Turning now to FIG. 13, an exemplary computer system 50 is illustrated. 
Computer system 50 illustrates the general features of a computer system that can be 
used to implement the invention. Of course, these features are merely exemplary, and 
it should be understood that the invention can be implemented using different types of 
hardware that can include more or different features. It should be noted that the 
computer system can be implemented in many different environments, such as 
onboard an aircraft to provide onboard diagnostics, or on the ground to provide 
remote diagnostics. The exemplary computer system 50 includes a processor 110, an 
interface 130, a storage device 190, a bus 170 and a memory 180. In accordance with 
the preferred embodiments of the invention, the memory system 50 includes a fuzzy 
logic fault detection program, which includes a sensor data processor program and a 
fuzzy logic inference system program. 

[0079] The processor 110 performs the computation and control functions of the 
system 50. The processor 110 may comprise any type of processor, include single 
integrated circuits such as a microprocessor, or may comprise any suitable number of 
integrated circuit devices and/or circuit boards working in cooperation to accomplish 
the functions of a processing unit. In addition, processor 110 may comprise multiple 
processors implemented on separate systans. In addition, the processor 110 may be 
part of an overall vehicle control, navigation, avionics, communication or diagnostic 
system. During operation, the processor 110 executes the programs contained within 
memory 180 and as such, controls the general operation of the computer system 50. 

[0080] Memory 1 80 can be any type of suitable memory. This would include the 

various types of dynamic random access memory (DRAM) such as SDRAM, the 
various types of static RAM (SRAM), and the various types of non- volatile memory 
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(PROM, EPROM, and flash). It should be understood that memory 1 80 may be a 
single type of memory component, or it may be composed of many different types of 
memory components. In addition, the memory 1 80 and the processor 110 may be 
distributed across several different computers that collectively comprise system 50. 
For example, a portion of memory 180 may reside on the vehicle system computer, 
and another portion may reside on a ground based diagnostic computer. 

[0081] The bus 170 serves to transmit programs, data, status and other 
information or signals between the various components of system 100. The bus 170 
can be any suitable physical or logical means of connecting computer systems and 
components. This includes, but is not limited to, direct hard-wired connections, fiber 
optics, infirared and wireless bus technologies. 

[0082] The interface 130 allows communication to the system 50, and can be 
implemented using any suitable method and apparatus. It can include a network 
interfaces to communicate to other systems, terminal interfaces to communicate with 
technicians, and storage interfaces to connect to storage apparatuses such as storage 
device 190. Storage device 190 can be any suitable type of storage apparatus, 
including direct access storage devices such as hard disk drives, flash systems, floppy 
disk drives and optical disk drives. As shown in FIG. 13, storage device 190 can 
comprise a disc drive device that uses discs 195 to store data. 

[0083] In accordance with the preferred embodiments of the invention, the 
computer system 50 includes a monotonic regression trending program. Specifically 
during operation, the monotonic regression trending program is stored in memory 180 
and executed by processor 110. When being executed by the processor 110, 
monotonic regression trending program receives sensor data and determines estimated 
trends of performance parameters derived fi-om that sensor data. These estimated 
trends can be then used by a technician or other user to interact with the system in 
order to arrive at proper diagnostic and prognostics. 
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[0084] As one example implementation, the trending system can operate on data 
that is acquired from the mechanical system (e.g., aircraft) and periodically uploaded 
to an intemet website. The monotonic regression analysis is performed by the web 
site and the results are retumed back to the technician or other user. Thus, the system 
can be implemented as part of a web-based diagnostic and prognostic system. 

[0085] It should be understood that while the present invention is described here 
in the context of a fully fimctioning computer system, those skilled in the art will 
recognize that the mechanisms of the present invention are capable of being 
distributed as a program product in a variety of forms, and that the present invention 
applies equally regardless of the particular type of signal bearing media used to carry 
out the distribution. Examples of signal bearing media include: recordable media 
such as floppy disks, hard drives, memory cards and optical disks (e.g., disk 195), and 
transmission media such as digital and analog communication links, including 
wireless communication links. 

[0086] It should also be understood that while the present invention has been 
described as a trending system for trending turbine machinery performance, that the 
present invention can also be applied to other mechanical systems in general and other 
aircraft systems in particular. Examples of the types of aircraft systems that the 
present invention can be applied to include environmental control systems, aircraft 
hydraulic systems, aircraft fiiel delivery systems, lubrication systems, engine starter 
systems, aircraft landing systems, flight control systems and nuclear, biological, 
chemical (NBC) detection systems. 

[0087] The present invention thus provides a system and method for trending 
performance in a mechanical system. The trending system includes a performance 
estimator and a predictive trending mechanism. The performance estimator receives 
sensor data from the mechanical system and generates performance parameter 
estimates for the mechanical system. The performance parameter estimates are 
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parametric data that are indicative of performance in the mechanical system. The 
performance parameter estimates are passed to a predictive trending mechanism. The 
predictive trending mechanism determines an estimated trend for the performance 
parameter estimates through monotonic regression of the performance parameter 
estimates. The estimated trend of the performance parameter estimates can include 
filtered values of the performance parameter estimates and/or predictions of future 
performance parameters. 

[0088] The embodiments and examples set forth herein were presented in order to 
best explain the present invention and its particular application and to thereby enable 
those skilled in the art to make and use the invention. However, those skilled in the 

art will recognize that the foregoing description and examples have been presented for 
the purposes of illustration and example only. The description as set forth is not 
intended to be exhaustive or to limit the invention to the precise form disclosed. 
Many modifications and variations are possible in light of the above teaching without 
departing fi-om the spirit of the forthcoming claims. 



